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CROSS-REFERENCE TO RELATED APPLICATIONS 
[0001] This application claims the benefit under 35 U.S.C Section 1 19(e) of the 
following co-pending and commonly-assigned U.S. provisional patent application, which 
is incorporated by reference herein: 
5 [0002] United States Provisional Patent Application Serial No. 06/235,723, entided 
"CLIENT-BASED INTERACTIVE DTV ARCHITECTURE", filed on September 27, 
2000 by Edward Y. Chang et. al., Attorney Docket No. 30794.82USP1. 



BACKGROUND OF THE INVENTION 
10 1 . Field of the Invention, 

[0003] The present invention relates generally to broadcast digital television, and in 
particular, to a method, apparatus, and article of manufacture for supporting multiple 
digital video streams. 

15 2. Description of the Related Art 

[0004] The Federal Communications Commission (FCC) has mandated TV 
broadcasters to transmit TV in the digital format (referred to as digital television [DTV]) 
by the year 2006. The flexibility and extensibility of an all-digital system enable a wide 
range of interesting applications. 

20 [0005] Both video on demand (VOD) and single user digital VCR devices have not 
generated much real interest. The reality of VOD is quite different from its hype. For 
example, while VOD trials are dribbling out in places like Cincinnati, Honolulu, Atlanta, 
and Los Angeles, only a small number of homes actually use the services. Meanwhile, 
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personal VCRs have had limited acceptance because of their single user constraint and 
high cost 

[0006] One type of interesting application that may benefit and utilize an all-digital 
system is interactive DTV. Several schemes have been proposed for supporting 
5 interactive operations. These schemes can be divided into two approaches: (1) using 
separate fast scan streams, and (2) skipping frames in the regular stream. The first 
approach may not be used in the broadcast scenario since a program is broadcast at one 
single rate. The frame skipping approach can cause low IO (input-output) resolution 
and consequendy low system throughput. 
10 [0007] In a prior art client-side approach, a client re-encodes frames during normal 
playback and saves them for replay. This approach can be CPU-intensive since most 
compression schemes are encoding side heavy and hence may hinder a CPU from 
decoding more streams. 

[0008] Many studies have proposed server-based interactive DTV architectures in 
15 which a server schedules its resources (e.g., memory and disk bandwidth) to service 

interactive VCR-like requests, such as pause, replay and fast-forward. In a server-based 
architecture, the clients are assumed to be passive, simply receiving bits and rendering 
frames. However, because of the typical long end-to-end transmission delay between a 
server and a client and the Internet's limited bandwidth, it is practically infeasible for the 
20 server to support "real-time" VCR-like interactive operations for tens of thousands of 
simultaneous users. Furthermore, on a broadcast channel (e.g., CNN), one simply 
cannot request the server to pause or to replay a program. 
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[0009] Accordingly, what is needed is an interactive DTV system that supports 
multiple users. 



SUMMARY OF THE INVENTION 
5 [0010] One or more embodiments of the invention provide a method, apparatus, and 
article of manufacture for supporting multiple interactive digital video streams, A client- 
based architecture supports time-shift Digital-TV (DTV) features (Le., pause, replay and 
fast-forward) and interactive applications. 

[0011] To enable interactivity such as East forward instant replay pause and slow 
10 motion for multiple users, data is organized effectively for improving IO resolution, 
reducing disk latency, and minimizing storage cost Three data placement schemes are 
built on a simple real time memory management module. These schemes make different 
tradeoffs between IO resolution, disk latency, and cost to maximize system throughput 
under different resource constraints. Additionally, to assist selecting the right placement 
15 scheme in a given situation, selection guidelines and an admission control policy may be 
used to adapt to almost any performance objective 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0012] Referring now to the drawings in which like reference numbers represent 
20 corresponding parts throughout 

[0013] FIG. 1 depicts a personalizable DTV pipeline in accordance with one or more 
embodiments of the invention; 

[0014] FIG. 2 shows four examples of representative delay functions in accordance 
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with one or more embodiments of the invention; 

[0015] FIG. 3 illustrates the use of memory pages in accordance with one or more 
embodiments of the invention 

[0016] FIG. 4 shows a truncated binary tree formation for supporting three fast-scan 
5 speeds in accordance with one or more embodiments of the invention; 

[0017] FIG. 5 presents an example that shows how I frames are distributed in 
accordance with one or more embodiments of the invention; 
[0018] FIG. 6 compares the memory use of various data placement schemes in 
accordance with one or more embodiments of the invention; 

10 [0019] FIGS. 7(a)-7(f) comprise various graphs that illustrate the relationship between 
the memory requirement and fast scan speedup for various data placement schemes 
and/ or K values in accordance with one or more embodiments of the invention; and 
[0020] FIG. 8 is a flow chart illustrating the support of multiple interactive digital 
video streams in accordance with one or more embodiments of the invention in 

15 accordance with one or more embodiments of the invention. 
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nF.TATT.Rn D ESCRIPTION OF THE PREFERRED EMBODIMENTS 
[0021] In the following description, reference is made to the accompanying drawings 
which form a part hereof, and which is shown, by way of illustration, several 
embodiments of the present invention. It is understood that other embodiments may be 
5 utilized and structural changes may be made without departing from the scope of the 
present invention. 



Overview 

[0022] One or more embodiments of the invention provide a novel system 
10 architecture that plays a client/server dual role to enable non interactive broadcast DTV 
streams into interactive ones for supporting multiple playback devices (e.g., in a library, 
in a classroom, or at home). Broadcast data is received and strategically placed to 
provide interactive capabilities. Three data placement schemes are built on a simple real 
time memory management module. These schemes make different tradeoffs between 
15 IO resolution, disk latency, and cost to maximize system throughput under different 
resource constraints. Additionally, to assist selecting the right placement scheme in a 
given situation, an admission control policy provides the ability to adapt to almost any 
performance objective. 

[0023] Embodiments of the invention are based on a client-based interactive DTV 
20 architecture (referred to as Personalizable Interactive DTV). A receiver (a digital VCR 
or set top box) in this architecture is equipped with a large and inexpensive disk. A 
client can cache a large amount of media data received via a broadcast This economical 
caching together with the random access capability of the disk enables a client to support 
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time-shift: operations. A viewer can pause a live DTV program to take a break from 
viewing while the broadcast stream continues arriving and being written to the local disk. 
The viewer can resume watching the program after the pause with a delay, or fast- 
forward the program to get back in synch with the broadcast stream. The viewer can 
5 also record programs, filter out unwanted content, and produce a customized program 
which a tape-based VCR cannot do. 

[0024] These time-shift functions allow one, for example, to do one's own instant 
replay during a sports program or to watch a remote lecture at one's own pace. One can 
also record programs at multiple channels at the same time (which a tape-based VCR 

10 cannot do), filter out unwanted content, and produce a customized program. 

[0025] Adding an Internet back-channel in addition to the disk to a client (e.g., DTV 
box 106) allows media content to be customized in many ways without the client 
interacting with a server. While a given broadcast stream remains the same for all 
viewers, various data objects can be transmitted to individual viewers via the Internet 

1 5 channel. Data objects can be textual (e.g., a hypertext markup language page), binary 
( e -g-> a Java™ applet), or continuous (e.g., a video/audio stream). 
[0026] Image-based rendering techniques can overlay a number of data objects with 
the broadcast stream to provide a customized program. For instance, a viewer can query 
and change the attributes (e.g., color, shape, position and history) of these data objects or 

20 a broadcaster can target individual families with tailored advertisements via the back- 
channeL 

[0027] With image-rendering techniques, the invention allows the viewer 1 10 to 
influence TV content at the frame level. For example, a virtual museum program may 
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deliver data at very high rates but the DTV box 106 decodes, stitches, and displays only 
the frames that the user 110 views. In such an embodiment, children would be able to 
change the attributes (e.g., colors, size, position and even the personality) of a "bunny", 
,c big bird", or other characters in a children's program. Similarly, a grade school student 
5 can learn American states by interacting with a map. 

[0028] Adding an Internet back-channel in addition to a large disk to the DTV box 
106 enables many more potential applications such as customized news, soaps, ads, and 
enhanced home-shopping channels. For example, self-paced distance learning may be 
enabled wherein a user 110 can view a lecture at one's own pace. Alternatively, a user 

10 110 can replay a video or an audio segment of a live program to provide personalized 
instant replay. In another instance, a user 110 can create a personalized news program 
by recording news playing on multiple channels at the same time and composing a 
customized program of one's desire (e.g., skipping all financial news). 
[0029] Managing heterogeneous DTV data objects (e.g., video, audio, texts, 3D 

15 graphics objects, etc.) at the client side to support interactive DTV features faces two 
major challenges: (1) different clients may have different available resources, and (2) 
different viewers may have different viewing preferences. A resource manager at the 
client side must allocate and schedule available resources adaptively to maximize each 
individual viewer's quality requirement 

20 [0030] Various techniques of the invention may be used to manage DTV data objects 
under the constraints of the local resources to maximize the client's quality of service 
(QoS). A viewer can assign a QoS factor to a data object to convey that object's 
scheduling priority to a resource manager. The resource manager then schedules the 
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local resources for the data objects in an order that maximkes the total QoS. The 
invention provides a client-based architecture that can support interactive DTV features 
effectively with very low memory requirements and hence at a low cost 
[0031] In addition, one or more embodiments of the invention support multiple 
5 interactive streams on one receiver (Le., one setup box or one digital VCR). With the 
multi stream capability, students in a virtual classroom or at a library can watch a live 
lecture at their own pace via one shared receiver. A family can use one receiver as the 
stream server at home to support interactivity at multiple playback devices. This 
architecture gives a receiver a client/ server dual role. On the one hand, the receiver acts 

10 as a client for broadcasters or servers to enable interactivity. On the other hand, the 
receiver caches streams for servicing a number of end devices to amortize cost 
[0032] Designing a client/server dual system to support interactivity however, is a 
non-trivial task. On the one hand, the receiver must write broadcast signals to its disk to 
minimise memory use for staging streams. On the other hand, the receiver must read 

15 data from the disk into main memory before the decoder runs out of data. In addition, 
when simultaneous fast scans (Le., fast forward and replay) are requested, the reads can 
happen at very high rates. The system must ensure that all IOs can be done not only on 
time to meet their deadlines but also at the minimum cost. 
[0033] Accordingly, in designing an appropriate receiver, at least three design 

20 parameters should be kept in mind: IO resolution, disk latency, and storage cost (both 
memory and disk cost). Since the improvement on one performance factor can often 
lead to the degradation of the others, tradeoffs between these design parameters must be 
considered and made carefully. Memory management and data placement policies of the 
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invention provide support for multiple simultaneous interactive streams. 
[0034] A simple memory management scheme that is efficient and easy to implement 
may be used. On top of this memory management scheme, three data placement 
policies are utilized Additionally, to assist selecting the right placement scheme to 
5 employ in a given situation, selection guidelines and an admission control policy may be 
used to adapt to select the appropriate placement scheme to accomplish almost any 
performance objective. 



Hardware Environment 

10 [0035] FIG. 1 depicts a personalizable DTV pipeline 100. On the left-hand side of the 
pipeline 100, data objects 102 are transmitted via broadcast 104 and point-to-point 
channels to a DTV box 106. The DTV box 106 receives network packets in its main 
memory 108. If the data 102 is not needed shortly (e.g., the viewer 110 paused the 
playback), the data 102 is written to the box's 106 local disk 112 to conserve memory. 

15 The data 102 is made available to the CPU 114 before it is needed. The CPU 114 

processes (e.g., computes, decodes, renders, etc.) the data 102 in main memory 108, and 
finally the processed data 102 is played back to the viewer 1 10 on the right-hand side of 
the pipeline 100. 

[0036] A DTV pipeline 100 consists of two major components: DTV data objects 102, 
20 and system resources, including CPU 114, memory 108, and a local disk 112. 

[0037] Data objects 102 can be continuous, textual, binary, and so forth. The objects 
102 are best characterized by their sizes and latency constraints. Continuous data 1Q2 
may comprise audio/video streams, which can be voluminous (video streams) and delay 
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sensitive. Textual data may include captions, HTML and XML documents, etc. Textual 
data in general occupy far less space than continuous data and are not delay sensitive. 
Other data objects 102, such as images and applets, can be very copious or scant and 
may or may not be delay sensitive, depending on the nature of the application. 
5 [0038] The si2e of a data object is measured by the amount of storage space it needs 
and is denoted by Si, where i stands for the i* object To quantify the delay sensitivity of 
a data object 102, one can specify a value function for it The function can be defined in 
many ways. FIG. 2 shows four examples of representative delay functions. The x-axis 
in FIG. 2 depicts delay, while the y-axis depicts the value of the object normalized to 

10 from zero (worthless) to one. 

[0039] Function F a depicts an object that can tolerate delay up to a period of time, t s , 
after which the object becomes worthless. Function Fb shows the value of an object that 
decays linearly after t s . Functions F c and Fd have other value decay patterns. Function 
Fa is a good value function for an audio frame. Function Fb may be a good value 

15 function for a video frame since slight delay of a frame display may be tolerable. 

Function Fb may be a good value function for a subtide. Function Fd, which shows that 
a user's patience decays exponentially after t 5 , may be a good value function for a Web 

page. Without losing generality, the value function for object i is defined as £(t), where t 
denotes the span between the time the object is requested and the time the object is 
20 available in main memory for processing. 

[0040] In short, data objects may be characterized with S g - representing the i h object's 

storage requirement, and £$) depicting the i* object's delay sensitivity. 

[0041] As described above, the other major component (besides data objects 102) are 
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system resources. The system resources likely include a CPU 114, memory 108, and a 
local disk 112. Local disk 112 may be a large inexpensive disk that enables a DTV box 
106 to cache a large amount of media data (e.g., data objects 102). 



5 Scheduling Resources 

[0042] A resource manager at the client side must allocate and schedule available 
resources adaptively to maximize each individual viewer's quality requirement As 
described above, the local resources include CPU 114, memory 108, disk bandwidth and 
network bandwidth. The local resources may not be adequate to support a particular 

10 interactive scenario. Therefore, it is critical for the resource manager to be adaptive to 
the resource constraints and to degrade, if degradation is unavoidable, in a graceful 
manner. Given limited resources, the design objective of a DTV" box 106 is to prioritize 
resource allocation in order to maximize the user's 110 satisfaction. 
[0043] To measure a user's 110 satisfaction, the user may provide information 

15 regarding what is important and what is not Accordingly, each data object 102 may be 
associated with a QoS parameter to convey that object's 102 scheduling priority to the 
resource manager. The viewer 110 can assign a QoS value to each data object 102, 
either implicitly or explicitly. For instance, if a user 110 decides to turn off all interactive 
features, the resource manager can assign a QoS factor of zero to data objects 102 that 

20 are needed to support interactive features. With respect to the data objects 102 that are 
needed to support the playback, higher QoS can be assigned to mission-critical data 
objects, such as broadcast video and audio streams, and lower QoS can be assigned to 
optional data objects such as captions and applets. 
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[0044] The resource manager then schedules the local resources for the data objects 
102 in an order that maximizes the total QoS. Thus, given N ai/ requested data objects 
and M available memory, the goal of the resource manager is to schedule N data objects 
(N< N all ) to maximize the total QoS under the resource constraints. or, denotes the 
5 QoS requirement assigned to the f data object 102 (0 < a t £ 1 ) and x i denotes the 

latency needed to stage the /* data object 102 in main memory. The value of r l depends 
on the local disk 112 bandwidth and network bandwidth, and the size of the data object 
102. Further, suppose j represents the scheduling order for N data objects 102. The 
objective function for scheduling the service to these N data objects in the order that 
10 maximizes the sum of the QoS can be written as: 



N f J \ 



which is subject to the memory constraint ^5,- < M , 

7=1 



Supporting Regular Playback. Pause, and Slow Motion 

15 [0045] Referring again to FIG. 1, to support interactive operations, a receiver 116 in a 
DTV box 106 may need a huge amount of buffer. For instance, pausing a 6.4-Mbps 
DTV stream for thirty minutes requires 1.44 GBytes of cushion. Pausing a 19.2-Mbps 
HDTV stream for the same duration requires 4.32 GBytes of buffer. One or more 
embodiments of the invention manage the receiver's 116 local resources efficiently so 

20 that the DRAM requirement can be drastically reduced. A memory 108 allocation 
scheme as described herein provides support for regular playback and pause. 
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[0046] Referring now to FIG. 3, for the regular playback of a continuous data stream, 
a resource manager allocates four memory pages (B1-B4) of equal size. These four pages 
are ping-ponged between the receiver 116 and the decoder 202 and are used to receive 
incoming data from the network, write data to the disk 1 12, read data from the disk 112, 
5 and provide data for decoding. The receiver 116 and the decoder 202 may each own at 
most two pages at any time (even during a pause or a slow motion operation). The 
following example illustrates how the resource manager manages these four pages for a 
video playback. 

[0047] At the start of the video playback the resource manager allocates four pages 
10 denoted by Bl, B2, B3, and B4, for a stream. Once data arrives, the resource manager 
receives the data in one of the pages, (e.g., Bl). When Bl is full, Bl is available for 
decoding and hence the resource manager hands Bl to the decoder 202. In this 
example, assume the playback starts once Bl is filled up and is assigned to the decoder 
202. The playback can start earlier or later depending on the difference between the data 
1 5 delivery and playback rates. 

[0048] For example, if the data delivery rate is substantially lower than the playback 
rate the resource manager must accumulate enough data on disk 112 before the playback 
can start to prevent display hiccups. At the same time, the resource manager assigns 
another memory page say B2, to the receiver 116 to continue receiving data. When page 
20 B2 is full, the resource manager hands B2 to the decoder 202 and assigns B3 to the 
receiver 116 to continue receiving data. At this time, the decoder 202 owns pages Bl 
and B2 and the receiver 116 owns B3. 

[0049] One of two events occurs next: either the data in page Bl is used up by the . 
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decoder 202 or page B3 is filled up by the incoming packets. The resource manager 
takes different actions according to which event occurs first 

[0050] If Bl is used up first, the resource manager simply returns the page to the free 
pool. However, if B3 is filled up first, the resource manager writes the page to the disk 
5 112. Note that the decoder 202 does not need B3 immediately. The decoder 202 only 
needs B2 to safeguard a hiccup free playback. When B3 is being written to the disk 112, 
Bl and B2 are held by the decoder 202. The resource manager must use page B4 to 
receive incoming data. B4 must be large enough for the resource manager to complete 
writing B3 to disk 1 12, or the receiver 116 runs out of memory space to receive data 
10 once B4 is full. 

[0051] At this time, one of two things can happen next: the data in page Bl is used up 
by the decoder 202 or page B4 is filled up by the arriving data. 
[0052] When Bl has been consumed by the decoder 202, the decoder 202 starts 
consuming B2. At the same time, the resource manager has to make sure that the data 

15 after that in B2 is made available to the decoder 202 before the decoder 202 uses up B2, 
or hiccups occur. If the decoder 202 uses up Bl before B3 is full, the resource manager 
assigns B3 to the decoder 202 as soon as the page is filled up. If B3 is filled up before 
page Bl is consumed, an IO to write B3 to the disk 112 may be in progress or may have 
been completed. In the former case, the resource manager still makes B3 available to the 

20 decoder 202 by ignoring the write (canceling the write may not be possible). If the write 
has been completed, the resource manager reads the data back from the disk 112 into Bl 
(the decoder 202 uses the data in Bl after B2 is consumed). Note that the size of page 
B2 must be large enough to allow enough time for page Bl to be replenished. 

15 
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[0053] If page B4 is filled up first, the resource manager writes the data to the local 
disk 112. Since either page Bl or B3 must have been free at this time, the resource 
manager uses the available page as the receiving buffer. 

[0054] In summary, the resource manager is driven by two events: page consumed, 
5 when the decoder 202 has consumed a page, and page full, when the receiver 116 has 
filled up a page. When the page consumed event occurs, the resource manager may 
need to read a page of data from the disk 112 before the decoder 202 uses up the next 
page. The page thus must be large enough to provide data to the decoder 202 before the 
read is completed. When the page full event occurs, the resource manager may need to 
10 write the page to the disk 1 12 to free up space for use. The page must be large enough 
so that during the write, the receiver 116 cannot fill up another page. This four-page 
ping pong scheme enjoys various benefits. 

[0055] One benefit is that when a pause is issued (the page consumed event is halted), 
the receiver 116 uses the local disk 112 as the cushion. Using the local disk 112 extends 
15 the buffering capacity drastically at the minimum cost The main memory requirement is 
limited to only four pages at all times. A second benefit is that the scheme can support 
slow motion without dropping any arriving bits or causing overflow of the decoder 202 
buffer. Additionally, the scheme does not perform unnecessary memory-to-memory or 
memory-to-disk 112 copy if the data is played back in real time. 

20 J 

Supporting Fast Scans 

[0056] The four-buffer ping-pong scheme described above may be extended to 
support fast-scan operations. A fast-scan plays back a media stream at K times its 
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encoding rate in either a forward direction (fast forward) or a backward direction 
(replay). 

[0057] As described herein, fast scans are discussed in the context of MPEG2 (Motion 
Pictures Expert Group 2) formatted streams. However, multiple different types of 
encoding schemes may be used in accordance with this invention and the scope of the 
invention is not intended to be limited to the MPEG2 format With the MPEG2 
format, a data stream/ sequence is encoded using three different types of frames: 
intraframes (I frames), predictive frames (P frames), and Bidirectional predictive frames 
(B frames). 

[0058] I frames contain data to construct a whole picture as they are composed of 
information from only one frame. 

[0059] P frames contain only predictive information (not a whole picture) generated 
by looking at the difference between the present frame and the previous one. P frames 
contain much less data than the I frames and so help towards low data rates that can be 
achieved with a MPEG signal 

[0060] B frames are composed by assessing the difference between the previous and 
the next frames in a television picture sequence (wherein such reference frames are 
either I frames or P frames). As B frames contain only predictive information, they do 
not make up a complete picture as so have the advantage of taking up much less data 
than the I frames. However, to see the original picture requires a whole sequence 
MPEG 2 frames to be decoded (including I frames and possibly P frames). 
[0061] To support a K-times speedup fast-scan the receiver 116 displays one out of 
every K frames. To allow K to be any positive integer, however, the receiver 116 can 
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suffer from high IO memory and CPU 114 overhead This is because a frame that is to 
be displayed (e.g., a B frame) may depend on some frames that are to be skipped (e.g., an 
I and a P frame). The receiver 116 may have to end up reading staging in main memory 
and decoding much more frames than it displays. Accordingly, by using appropriate data 
5 placement schemes, poor IO resolution may be remedied. 

[0062] Without loss of generality, a video can be assumed to consist of m frame 
sequences, wherein each sequence has S frames on an average, and is led by an I frame 
and followed by a number of P and B frames. To avoid processing the frames that are 
to be skipped, B frames are not involved in a fast-scan and a P frame is only played back 
10 if the P frame's dependent I frame is also involved in the fast scan. Such a restriction 

may not allow a user to request a fast-scan of every speedup. However, supporting a few 
(e.g., five) selected speeds of fast-scans may be adequate since a VCR or DVD player 
supports three to five fast-scan speeds. 

[0063] To improve IO resolution, frames that are not involved in a fast-scan are not 
15 read in. Upon initial examination, it may appear that a stream can be placed sequentially 
on disk 112 and just those selected frames may be read from the file stored thereon. 
This naive approach however does not save read time since the disk 112 arm still has to 
pass the skipped frames (e.g., B frames) on the track on its way to the selected frames 
(e.g., I frames). In addition, most modem disks 112 read the entire track into disk 112 
20 cache before transferring the selected frames. As a consequence, the throughput of the 
disk degrades severely. 

[0064] To improve IO resolution, three K -file data placement schemes may be used. 
Each scheme separates a video into two groups: an I-frame group and a P and B frame 
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group. The schemes distribute I frames into I-files and stores P and B frames in a PB- 
file. When a 8 x n (n is a positive integer) times speedup fast-scan is requested, the 
receiver 116 needs to read one or more I-files only. However, separating frames into 
more than one file incurs additional IO overhead for writes. This is because rather than 
5 performing one sequential IO to write out a data block, multiple writes must be 
performed for each file thereby increasing the number of seeks. 
[0065] Accordingly, one or more embodiments of the invention provide a carefully 
designed system that manages the tradeoffs between design goals such as improving IO 
resolution, reducing disk latency, and minimizing storage (memory and disk 112) cost. 
10 [0066] The three schemes described herein are the file Round Robin (RR) scheme, the 
file Truncated Binary Tree (TBI) scheme, and the file Truncated Binary Tree with 
Replication (TBTR) scheme. Each of the schemes has distinct advantages and 
disadvantages. 

[0067] For example, while the Round Robin scheme enjoys lower disk cost, it may 
1 5 suffer in terms of disk latency. Comparatively, the TBT scheme may enjoy good IO 

resolution, but at the cost of disk latency. Further, the TBT scheme with replication may 
provide good IO resolution and lower disk latency, but at the expense of disk 1 12 cost. 
Table 1 summarizes the pros with positive signs and cons with negative signs of these 
data placement schemes with respect to IO resolution, disk latency, and disk cost These 
20 pros and cons will become evident as the schemes are described in greater detail below. 



Scheme 


IO Resolution 


Disk Latency 


Disk Cost I 


Sequential File 




+ 


+ 


Round Robin 


+ 




+ 
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TBT J ++ 




+ 


TBT with Replication ++ 


+ 





TABLE 1: Scheme Summary(+ is an advantage and — is a disadvantage) 



K -File Round-'Rfibinn (RR) 
[0068] The round-robin (RR.) scheme is a simple method to improve IO resolution. 
5 Let the I-Frames be numbered as Ii, I2, 13. - .Im. The RR placement scheme stores P and 
B frames in a separate file and distributes I frames among K I-files, Fi, F2,. . .F*- , in the 
following round robin manner: 



•f} 



[0069] For example, with K =3, there are three I-files, Fl, F2 and F3, consisting of the 
10 following frames Fl = {Ii, I 4 , 1?, I10, . . . }, F2 = {I2, Is, Is, In, . . . }, and 

F3={I 3 ,l6,l9,Il2,...}. 

[0070] How this scheme works depends on the requested speedup (K) of the fast- 
scan. Suppose 8 =9 and K =3. A K=27-times speedup fast-scan reads frames from 
only one I-file for playback. A faster fast-scan (e.g., K=54 or 81) requires reading only 
15 one I-file, but at a fester pace by skipping some I frames, which leads to low IO 
resolution. The value of K may be increased to improve IO resolution. However, 
increasing K increases disk latency for preparing I-files and for supporting lower 
speedup fastscans. To maintain good IO resolution without aggravating disk latency, the 
following k -File TBT scheme may be utilized. 

20 
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K -File Truncated Binary Tree (TBT) 
[0071] In the Truncated Binary Tree (TBI) approach, good IO resolution may be 
provided at all fast-scan speeds while maintaining low disk latency at the same time. To 
provide good IO resolution, I frames are organized into a tree structure so that only 
5 wanted frames are read. To control seek overhead, two control parameters, a and J3 , 
may be utilized (see description below). 

[0072] An example TBT tree is presented in FIG. 4 which shows a truncated binary 
tree formation for supporting three fast-scan speeds: S -speedup, 3 5 -speedup and 6S - 
speedup. A normal playback requires retrieval of frames from the tree by performing an 

10 in-order traversal For fast-scans, different tree levels are retrieved depending on the 

requested speed. The higher the speed, the higher the tree-levels the fast scan operation 
reads. For example a 3 8 -times speedup fast-scan accesses the I frames at levels one and 
two in the tree and a 6 5 -times fast-scan reads I frames at level two only. 
[0073] Formally, the TBT scheme distributes I frames among K I-files, Fl, F2. . .F K , 

15 in the following manner 

F x ={l K \l<fc<mnI K ^{F 2 uF 3 uF A -'UF JC }} such that 

[0074] Here a is the Frame Span factor and J3 is the Scan Speed Resolution factor. 
Parameter a determines the number of I frames bunched together in the lowest level of 
20 the tree. Parameter fi determines the number of I frames to be read at the same level 
(or file) before being required to read from a file at a higher level in the tree. The values 
of a , J3 , and S determine the fast-scan speeds that the system can support For 
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example, if we let S =9, a =3 and and f} =3, then the speedups available ate 3, 9, 27, 
81, etc. If p is increased from three to four, then the accessible speedups become 3, 9, 
36, 144, etc. 

[0075] FIG. 5 presents an example that shows how I frames are distributed when 
5 K =3, a =3 and and fi =3. In FIG. 5, three I-files contain the following frames: 
F1 = {I1, 12, 14, 15,. ..17, 18,...} 
F2= {13, 16,112,115,121,...} 
F3= {19,118,136,145,...} 

10 Truncated-Binary-Tm with data Replication flUTR) 

[0076] Although the TBT scheme enjoys improved IO resolution, its disk 112 latency 
can be high due to the need to read data from more than one file. The TBTR scheme 
trades disk storage to reduce disk latency. Again, to achieve good IO resolution, the 
same I frame distribution method as the TBT scheme is used. In addition, I frames are 

15 replicated at higher levels of the tree in all files at lower levels. The I frames in the I-files 
are thus changed as follows: 

such that 

^ = l»e{lA3,-Hfor2£/£* 

[0077] Table 2 illustrates the parameters used in the above equations for the TBTR 
20 scheme. 



Parameter 


Description 


N 


Number of simultaneous streams 


T 


Total IO time cycle 


Tr 


Time taken to read from disk for a single stream in Time T 


Tw 


Time taken to write broadcast data for single stream in time T 
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TR 


■LYl 1 1 1 1 1 1 Hi 1 1 1 UloJV Uau LL<111&I,CL XaLC 


A"/ 


VYUIjL wADC utLClXlvy lAJ OCCJV. Li l_Lal»JYo 


JL/K 


Display rate or MPxiCj stream 


D 


Buffer size to support a single stream 


Memmin 


Minimum memory required to support N streams 


CT 


Average size of an I frame 


K 


IXUIUDCl OI X**£UCo 


TT 


.overage numoer oi i-.rranies in ourrer d 


K 


■ NtippH nf fo cf c/»?iti fpnn pctpH 


Kmax 


Maximum Speed of fast scan supported 


a 


Frame Span factor 


P 


Scan Speed Resolution factor 


<P 


Size of I frame over average frame size 


S 


Number of frames separating 2 I Frames in the MPEG stream 



TABLE 2: Equation Parameters 



[0078] For example with K =3, a =8, and fi =2, three I-files contain the following I 
frames: 

Fl= {11,12,13,14...} 
5 F2= {18,116,124,132...} 

F3= {116,132,148,164...} 
[0079] The advantage of the TBTR scheme is that one sequential file supports each 
fast-scan speed. Therefore, 100% IO resolution with minimum disk latency at the same 
time may be achieved. During normal playback, for instance, only file Fl (plus the PB- 
10 file) may be read. During fast-scans, only one I-file may be read. For example, for a 
16 S -speedup fast scan, only file F2 may be read. Improving IO resolution reduces 
memory use. But replicating data on disk 112 increases disk 112 storage cost and 
increases data transfer overhead to replicate data in multiple I-files. 

15 Quantitative Analysis 

[0080] In order to understand how the design parameters, IO resolution, disk latency, 
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and storage cost interplay with one another, the resource requirement for each of the 
schemes is formulated as described below. 

[0081] Suppose the system serves N simultaneous streams with T denoting the cycle 
time for completing a round of IOs for servicing N streams. In time cycle T, the system 
5 executes the following procedures simultaneously: 

1 . Each stream is served by a Receiving Thread that takes care of reading in 
broadcast data for the stream and storing it in the Receiving Buffer for that 
stream. The Receiving Buffer is large enough to hold all incoming data for 
IO time cycle T. When the buffer gets filled, this thread triggers a write IO 

10 to free the buffer for more incoming data. 

2. At the same time, an IO scheduler thread chooses a stream to serve and 
schedules a read IO for reading into the Display Buffer. Read IO may or 
may not be required depending on whether the playback stream is delayed in 
time or not The read IO also depends on user interaction. If the user has 

15 paused and the Display Buffer already has data for time cycle T, then no IO 

is required. The worst case (Le., requiring read IO) for all calculations is 
assumed. The Display Buffer again, has to be large enough to support 
playback for time T. The read IO can serve a fast-scan or a normal playback 
depending on user interaction. If a fast-scan request is issued by the user, 

20 then only the I-Files need to be read from, else the PB-File also needs to be 

read. This process is repeated for each of the N streams. 

3. Each stream also has a Display thread that displays MPEG data stored in the 
Display Buffer to the viewer. 
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[0082] The unit time cycle may repeated over and over again. Even though this model 
may be event driven, there exists a basic time cycle in which all IO operations for N 
streams are served. To analyze the receiver's 116 use of main memory, the invention 
attempts to avoid as much as possible, display hiccups due to variability and delays in the 
5 input stream. Studies have shown that even just losing 0.1% of data may cause 
significant degradation in display quality resulting from inter-frame decoding 
dependencies. Therefore, taking a conservative approach, the worst case disk latency is 
assumed as well as peak data consumption and input rates. 
[0083] An IO cycle T consists of writes and reads. Suppose each file is stored 
10 physically contiguous on disk 112. First, the worst case write time and the worst case 
read time are modeled and then combined to compute the IO cycle time for both 
placement schemes. The parameters used in deriving equations are illustrated in Table 2 
above. 

15 K -File Round-Rabin 

[0084] The K -File Round-Robin placement scheme needs to write the arriving video 
to K I-files and one PB-file. The size of the buffer required to sustain playback for time 
T can be written as B = Tx DR . The number of seeks for writing is K + 1 , and the data 

transfer time is capped by — . The worst case IO write time denoted as T v can be 

77? 

20 written as: 

r w =(*r+iMrf)+^ 

where y(d) computes the average disk latency for seeking d tracks, B denotes the page 



25 



WO 02/28097 PCT/US01/30116 
size, and TR denotes the disk transfer rate. 

[0085] Next, the worst-case read time is modeled. Suppose the average size of an I 
frame is <p -times the size of an average frame. The worst-case read time are analyzed in 
the following four cases: 
5 1 . K < 5 : This captures normal playback and slower fast scan modes wherein 

all frames read need to be played back. In this case, all I-files and the PB-file 
are read. The seek overhead is (a: + 1) x y(d) and the data transfer time is 

since it may be assumed that each frame is replacedby an I frame and 

77? 

thus the IO size is <p -times the average page size B. 
10 2. K = K x 8 : All frames from a single I-file must be read to achieve a fast 

scan speed of KxS . The seek overhead is thus y{d) and the data transfer 

time is capped by . 

77t 

3. K-nxKxSi Read only one I-file but skip every n-\ out of n frames. The 

seek overhead is y(d) and the data transfer time is ^ X( P X ^ t Notice that 

kxSxTR 

15 the ^ „ factor in front of ^ represents the IO resolution. For 

kxS TR r 

instance, if Kmax= 81, K =3, and S =9, only one out of every three I frames 

in one I-file are displayed and hence needs to transfer data three times faster. 

4. Other K values: Other K values may not be supported since that can cause 
much higher DRAM requirement 

20 [0086] The worst-case read time for the Ks that may be supported happens in either 
the first or the third case, or 
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I TR fcxSxTR} 



[0087] Let T be the IO cycle time to input pages for the decoder 202 and to write out 
the incoming pages before the receiving buffer overflows. To support N simultaneous 
users, T may be written as T = Nx(T r +T W ). 

[0088] The size of the tegular playback buffer B must be large enough to sustain T 
time playback which can be expressed as B > DR x T , where DR is the peak display rate. 
To conserve memory, equality may be taken, resulting in B = DR x T . 
[0089] Based on the above equations B can be solved and expressed as: 



B- max 



2x(K + l)x r (d)xNxTRxDR (K + 2)xy(d)xNxTRxDR 



TR-(l + <p)xNxDR 



' TR-Nx(l + £2£\xDR 
\ rcxd) 



10 [0090] After obtaining B, the memory requirement to support an up to times 
speedup fast-scan for N users is Mem^ = 4 x N x B . 

K -File Truncated-Binary-Tree 
[0091] The Truncated-Binary-Tree scheme is analyzed first without data replication 
15 and then with replication. The Truncated-Binary-Tree scheme differs from the Round- 
Robin scheme mainly because of better IO resolution. The incoming data stream is 
written into at most K I-files and a PB-file. First, analysis common to both schemes is 
presented. The size of the buffer required to sustain playback for time T can be written 

T x DR 

as B = TxDR. The number of I frames in buffer of size B is given by I T = . 

q>xS l 

20 The number of seeks for writing is given by exp where exp is the minimum integer such 
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that— ^ <L 

[0092] Out of these seeks, (exp - 1) are seeks to I-files and 1 seek is for the PB-file. 
For example, let a = {} = 3 . Assume that the display begins from the first I frame II 
and that all I frames need to be read into the buffer. Accordingly, the number of I 

Tx DR 

5 frames to be read is determined by I T = . Based on the distribution of I frames 

<pxSj 

as described above, the last I frame that needs to be read is given by I ax ^\ , where exp 

is the minimum integer such that — — — < 1 . Accordingly, the number of I-files to be 
6 arx/? cxp 

read from is given by exp -/. 

[0093] In the worst case, even if the current display pointer is placed in an 
10 unfavourable position, the same number of seeks may still be achieved by dropping a 
single frame. By dropping a single frame, the memory requirement may be reduced 
considerably, without causing any noticeable degradation in quality. Further, to conserve 

memory it may be assumed that exp = log 5 — . 

p a 

[0094] The time for data transfer is given by — . The worst-case IO write time, 

TR 

1 5 denoted as Tw can be written as: 
r tf =expx^) + — 

[0095] Next, the worst-case read time may be modeled. The worst-case read time may 
be modeled in the following four cases: 

1. K<5\ This captures normal playback and slower fast scan modes. In this 
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case, all I-files and the PB-file may need to be read. Hence the number of 
seeks for reading is given by exp. If it is assumed that each frame is replaced 
by either an I frame of a P Frame, the seek delay is expx y(d) and the data 

transfer time is capped by — 1 

5 2. K = SoxK = ax fi l ~ x x 5\ This is the &st scan mode. Some of the I-Files 

may need to be read from. In this case, the buffer B has to be filled with 

only I Frames but more data may need to be read to maintain the same 

display rate. Hence, the number of I Frames in buffer B is given by 

tpxTxDR - . _ , r t . . . 

1 TF = — : — and, the number of seeks for reading is given by expF, 

S i 

10 where expF is the minimum integer such that — — < 1 . 

To conserve memory, it is assumed that equality holds in the above 

equation. Hence, exp F =log^ — . Thus, the seek delay is &xp F xy(d) and 

a 

thedatattansfertimeiscappedby^. 

77? 



15 3. Other K values: Other K values may not be supported since such support 

may cause much higher DRAM requirements. 
[0096] The worst-case read time for the Ks that may be supported happens in the 



second case. Hence, T r = log^ 



' tpxTxDR 
^ S,xa ) 



xy(d) + 



<pxB 
TR 
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[0097] Let T be the IO cycle time to input pages for the decoder and to write out the 
incoming pages before the receiving buffer overflows. To support N simultaneous 
users, T may be written as T = Nx(T r + T w ). 

[0098] The size of the regular playback buffer B must be large enough to sustain T 
5 time playback, which can be expressed as B > DR x T , where DR is the peak display 
rate. To conserve memory, equality may be taken, which provides B = DR x T . 
[0099] Based on the equations for T w , T f , T, and B described above, the equation for 
B may be reduced to: 



{2x r (d)xNxTRxDRJ *\axS it 



10 [0100] After B has been obtained, the memory requirement to support an up to Kmax 
times speedup fast-scan for N users can be obtain by Mem^ =4xNxB. 

Truncated-Binary-Tree with data Replication 
[0101] The time for writing arriving data to disk is modeled first. The number of seeks 
15 is the same as with the K -file truncated binary tree discussed above and the time for data 



1x5 

transfer is given by - — j~ . The factor of — is an upper bound on the data 

replication overhead. More data needs to be written out due to replication. The worst- 
case IO write time, denoted as T w can be written as: 



7;==expxKd) + 



xB 



TR 
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[0102] Next, the worst-case read time is modeled. The worst-case read time is 
analyzed in the following four cases: 

1. K<S: This captures normal playback and slower fast-scan modes. Due to 
replication, all I frames of the stream are present in file Fl . Hence, the 
number of seeks for reading is 2, one for seeking file Fl and the other for 
seeking the PB file. The seek delay is thus 2 x y{d) and data transfer time is 



TR 

2. K = SotK = <xx fi'~ l x S : This is the fast scan mode only the I-file Fi 
needs to be read from. Hence, the seek delay is y{d) and the data transfer 

10 time is capped by . 

77? 

3. Other K values: Other K values may not be supported since that may cause 
much higher DRAM requirements. 

[0103] The worst case read time for the Ks that may be supported happens in the first 
case or the second case. However, it may be noted that the extra seek during normal 
15 playback is overshadowed by the larger amount of data transfer involved in the fast scan 

operation. Hence, T r = y(d) 4* . 

772 

[0104] Let T be the IO cycle time to input pages for the decoder and to write out the 
incoming pages before the receiving buffer overflows. To support N simultaneous 
users, T may be written as: T = Nx(T r 
20 [0105] The size of the regular playback buffer B must be large enough to sustain T 
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time playback which can be expressed as B £ DR x T , where DR is the peak display rate. 
To conserve memory, equality may be taken resulting in B = DR x T . 
[0106] Based on the above equations for Tw, Tr, T, and B, the equation for B may 
assume the form: 



f 



772- 



1 + $? + — 

9. 



xNxDR 



y(d)xNxTRxDR 



xB = log fi 



f ftxB > 
^(pxaxS u 



[0107] After B has been obtained, the memory requirement to support an up to Kmox 
times speedup fast-scan for N users can be obtained by Mem min =4xNxB. 



Performance Evaluation 

10 [0108] Three factors may affect the performance of fast scans: 1) IO resolution, 2) disk 
latency, and 3) storage cost. The description below evaluates the performance of the 
data placement schemes of the invention. Since equations have been developed for 
computing memory use and overall cost, the parameters in the equations may be 
replaced with the parameters of a modern disk for use in the evaluation. The evaluation 

15 is intended to answer the following questions: 

[0109] How do the data placement schemes perform against a scheme that simply 
stores a video sequentially on disk? How does minimizing IO resolution affect disk 
latency? Can data replication reduce sufficient memory cost to make it effective? How 
should an admission control policy work to degrade the system performance in a 

20 graceful manner when the disk bandwidth or memory capacity cannot support N 
simultaneous fast scans? 
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[0110] Table 3 lists the parameters for a sample disk used to study and compare the 
data placement schemes. 



Parameter Name 


Value 


Disk Capacity 


26 Gbytes 


Number of cylinders, CYL 


50,298 


Min. Transfer Rate TR 


130 Mbps 


Rotational Speed (RPM) 


5,400 


Full Rotational Latency Time 


11.2 ms 


Min. Seek Time 


2.0 ms 


Average Seek Time 


8.9 ms 


Max. Seek Time 


18 ms 



TABLE 3 



[0111] In addition, it is assumed that the peak data consumption and input rates are 6.4 
5 Mbps (the standard DTV broadcast rate) and that the receiver has 512 MBytes of main 
memory. Note that although a different set of disk parameters can lead to different 
absolute performance values, the relative performance between schemes remain the 
same. 

1 0 Comparing K -File Schemes with Non-Optimised 

[0112] FIG. 6 compares the memory use of the various K -file schemes with the non- 
optimized scheme (the scheme that stores a video in a sequential file). For this 
comparison, it is assumed that N=2, 8 = 9, <p = 3, and a = = 3 . Although the 
comparison is performed with one set of values, the response of different schemes on 

15 varying the parameters remain similar. When K is large, the non optimized scheme 
simply runs out of disk bandwidth to support fast scans. This is because without 
maintaining high IO resolution, the disk'bandwidth cannot keep up with the high speed 
fast scan operations. The K -file Round Robin scheme uses much less main memory, 
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but even this scheme starts suffering at high speedups. The K -file TBT schemes 
maintain almost constant memory requirement for all speedups due to their good IO 
resolution. 

5 Evaluating the K -File Schemes 

[0113] To evaluate the K -file schemes, different N values may be used to determine 
how the K -file schemes cope with simultaneous users at different fast scan speedups. 
FIGS. 7(a)-7(f) comprise various graphs that illustrate the relationship between the 
memory requirement and fast scan speedup for the various schemes and/or K values. 

10 [0114] FIG. 7(a) shows that the Round Robin scheme can support low speedup fast 
scans with low memory use for up to N=3. But, the scheme needs more amounts of 
main memory to support K=81 even for two simultaneous users (N=2), and it simply 
may not be capable of supporting more than one stream doing K fast scans 
simultaneously. Additionally, it may be noted that the memory requirement for 

15 supporting K =9 and 27 is less than that for supporting K=l and 3. This discrepancy 
occurs because, to support K=9,27 times speedups, the PB-file does not need to be 
accessed and hence seek overhead is reduced. Furthermore, for K=27, only one I-file 
needs to be read and the IO resolution is 100%. Thus, this scheme may be used to 
reduce seek overhead. However, IO resolution may suffer at K>27 scan speeds. This 

20 suggests that the Round Robin scheme may only be good for lower scan speeds. 

[0115] FIG. 7(b) shows that the K -file TBT approach without data replication scheme 
is able to support up to four simultaneous streams each performing K=81 times fast 
scan. For small values of K, however, the TBT scheme suffers from high memory use 
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due to the large number of seeks caused by the large number of I-files it must read This 
result suggests that the TBT scheme is more suitable for supporting high speedup fast 
scans. 

[0116] FIG. 7(c) shows that the TBT scheme with data replication is able to support 
5 up to four simultaneous streams scanning at speeds of up to K=81. This scheme 

maintains constant memory use for all scan speedups. Another thing to be noted is that 
for small values of N (N=l , N=2), the normal playback mode (K=l) requires more 
memory than for fast scans. This is because for small N, the extra seek to the PB-File 
involved in normal playback dominates the data transfer overhead for fast scans. 

10 Although the replication scheme requires additional storage, it may conserve memory as 
well as improves disk utilization because of its better IO resolution. 
[0117] FIGS. 7(d)-7(f) compares the memory requirement for the three K -file schemes 
side by side at three speedups. FIG. 7(d) shows that the Round Robin scheme is able to 
support up to four streams at K=9 speedup, but not beyond due to huge memory 

15 requirement. Also for lower speedups the Round Robin scheme may outperform the 

TBT non replicated scheme. But as N increases, the IO resolution scalability of the TBT 
schemes kicks in and both TBT schemes outperform the Round Robin scheme. 
[0118] FIG. 7(e) shows that for K=27, the Round Robin scheme may perform better 
or at least as good as the TBT schemes. This is because at K=27, the IO resolution of 

20 the Round Robin scheme is 100% and the seek latency is minimum. But, for K=81 in 
FIG. 7(f), the Round Robin scheme is not able to keep up with the performance of the 
TBT schemes owing to degradation in IO resolution. 
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Storage Optimisation 

[0119] To answer the storage optimization question, the total cost of a system 
implemented using the TBT schemes and determine trade-offs may be evaluated. 
Embodiments of the invention may be used to support up to K=81 fast scan speedup 
5 (or greater). In computations, disk cost is assumed to be approximately one-hundredth 
of memory cost. The cost unit used is cost per GB of hard disk. The storage cost is 
direcdy proportional to the amount of buffer made available to the user for fast scan 
operations. 

[0120] For example, providing the user with 30 minutes of rewind or forward buffer 

10 adds a storage overhead of 30 x 60 x 6.4 x — megabits. The fraction — is the fraction 

<p. <p 

of data (composed of I frames) that needs to be replicated. The presence of distinct 

crossover points suggests the existence of a cost performance trade-off between the 

replicated and non-replicated TBT schemes. 

[0121] As the number of streams increases, the memory requirement for both the 
15 schemes increases. Although the disk storage cost for the TBT scheme also increases, it 
increases at a lower rate than the memory cost Thus the difference between the cost of 
the TBT scheme with replication and the cost of the TBT scheme reduces as the number 
of streams (N) increases. The point at which these costs are equal is the crossover point 
For 30 minutes of disk buffering, the crossover point occurs a little above one 
20 simultaneous user. This suggests that if a single user needs to be supported in the 

system, then the TBT scheme is optimal due to higher disk cost involved in the TBT 
scheme with replication. But if more than one user needs to be supported, the TBT 
scheme with replication more than makes up for the additional storage overhead by 
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providing excellent IO resolution. But for two hours of buffering, the non-replicated 
scheme is good for up to three simultaneous users. But since the cost difference 
between the TBT schemes is not much and given the fact that absolute cost of additional 
disk storage is relatively small, replication becomes an attractive option. 
5 [0122] In addition, if it is assumed that MemoryCost > 100 x DiskCost, then the 

cost 

crossover point moves down in the curves, suggesting that the ratio of the TBT 

benefit 

scheme with extra storage decreases. Further, if it is assumed that MemoryCost < lOOx 
cos t 

DiskCost, then the — ratio of the TBT scheme with extra storage increases, and 

benefit ^ 

the crossover point moves further up in the curves. 

10 [0123] In short, given system requirements and the cost ratios for memory and disk, it 

may be determined if replication is beneficial. 



Experimental Observations 
[0124] From the experimental results various observations may be made. For 
15 example, using the naive sequential placement policy incurs huge memory requirements 
and hence is not desirable . For low speedup (K<kxS) fast-scans, the IO resolution 
provided by the Round Robin scheme proves sufficient and performs well using a 
reasonable amount of memory. 

[0125] For high speedup (K > kx5) fast-scans, the Round Robin scheme suffers 
20 from poor IO resolution. The TBT schemes enjoy good IO resolution and hence ate 
able to perform better than the Round Robin scheme given the same amount of 
memory. For supporting a large number of users (N>4), the TBT scheme with 
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replication may be the choice. 

[0126] Additionally, if the cost difference of the TBT schemes is small, replication may 
become an attractive option given the fact that absolute cost of additional disk storage is 
small. 

5 [0127] With a different set of disk parameters, the absolute performance numbers 
described above and in the figures may be different However, the magnitude of 
difference is insignificant Most importantly, the experimental results show that 
intelligent data placement significantly improves a digital VCR's throughput and its 
quality of service. 

10 

Admission Control 

[0128] Various data placement policies may be utilized to improve system 
performance. However, a systematic procedure for choosing the best scheme to employ 
in a given situation would be useful. In addition, if a requested speedup cannot be 

15 serviced by the available system resources, it may be desirable to perform a graceful 
degradation to still satisfy the user's need to a certain degree. An admission control 
policy in accordance with the invention may achieve these goals. 
[0129] Suppose the placement policy is given by P where P € { Hound Robin', 
TBT, TBT with Replication'} . Let Mfree denote the Free system memory and M(K) 

20 denote the extra memory required to support a K speedup fast, scan stream. Also, let 
Mmin denote the minimum memory required to support fast scan at the lowest possible 
speed. 

[0130] The admission control policy is depicted in the pseudocode of TABLE 4. 
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Pt ocedure: Admission 
Variables: 

Input: 

- P : Placement Policy 

- Kin : requested Speed of fast-scan 

Output 

- allow : Boolean, denoting whether the stream should be admitted 

- Kout : Speed at which fast-scan stream will be served 
Execution: 

-If (Mf«e<Mmin) 

allow = false 

- Else SwitchO { 

1. Case (M (Kin) < Mr™) : 

1.1 Allow = true 

1.2 Kout = Kin 

2. Case (P == 'Round Robin 5 ) : 

2.1 K. =^ 

2.2 If (Mfrce < M (Kin) ) goto Step 2.1 

2.3 allow = true 

2.4 Kout = Kin 

3. Case (P == 'TBT or TBT without repldation') : 

3.1 

m p 

3.2 If (Mf ree < M(Kin) and Kin ^ a ) goto Step 3.1 

3.3 If (Mfe < M(Km) and P=TBT) 

3.3.1 allow = true 

3.3.2 Use method T>egrade-TBT' 

3.4 Else 

3.4.1 allow = true 

3.4.2 Kout = Kin 



TABLE 4 

[0131] If the &ee system memory cannot serve the lowest possible quality of fast scan 
using Mmin amount of memory (Le., Mfree < Mmb), the stream is not served and the 
program exits. Similarly, if this is not true (Le., Mfree ^ Hnin), it is known that the request 
35 will at least be served. If enough resources are available to serve the request (Le., M (Kin) 
< Mfree), the request is served. 

[0132] Otherwise, the method used to degrade service depends on the policy. If the 



39 



WO 02/28097 PCT/US01/30116 
policy is Round Robin, then the scan speed is reduced by a factor of k until the 
available system memory is able to support it If the policy is TBT with replication or 
TBT, then the scan speed is reduced by a factor J3 until the request may be served with 
free memory. Additionally, if the scheme is TBT, if the above method is not able to 
5 serve the request a method 'Degrade-TBT is used to serve the request 

[0133] The degrade-TBT method provides that the requested scan speed is 
K = ax f5 l ~ x x 8 . I frames are then read from file Fi only and all frames read are 

displayed. The fraction of frames dropped is approximately equal to — . Accordingly, 

P 

although there is degradation of quality, the request is served. 

10 [0134] Note that it is easy to modify the admission control policy to support different 
objective functions which in turn dictate QoS in the system. For instance, if the 
objective is to maximize the number of simultaneous users in the system, then the fast 
scan speeds may be degraded for the users accordingly. If the objective is to provide the 
best service to existing users, then less number of new users should be admitted. If the 

15 objective is to take both into consideration then the objective function, F, can be 
expressed as a function of K and N: 

v C(K 9 N) 

B(K,N) is the benefit obtained by serving N streams and a combined fast scan speed of 
K, for all streams. C(K,N) is the cost (memory + disk) for serving the N streams. 
20 Custom values can be obtained for B(K,N) depending on consumer behavior. The 
admission control policy can be easily modified to match the requirement of such a 
system. 
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[0135] FIG. 8 is a flow chart illustrating the support of multiple interactive digital 
video streams in accordance with one or more embodiments of the invention. At step 
802, a broadcast digital video stream is received. At step 804, the broadcast stream is 
stored into one or more I-files comprised of one or more I frames and one or more PB- 
5 files. Each PB-file is comprised of one or more P frames and/or B frames. At step 806, 
a display stream is provided that is based on the one or more I-files. Using the I-files 
(and one or more of the &ames in each I-file), multiple streams may be supported. 
[0136] As described above, the broadcast stream may be stored into a receiving buffer 
and stored in the I-files and PB-files when the receiving buffer is full. Further, to 
10 provide one or more display streams, each display stream may be stored/placed into a 
different display buffer and/ or displayed to a viewer 110. 

[0137] Additionally, step 804 may be performed using one of the data placement 
policies described above. Accordingly, the I frames may be distributed into one or more 
I- files in a round-robin manner, a truncated binary tree manner, or a truncated binary 
15 tree with data replication manner. Further, the appropriate policy may be used based on 
available system memory and other factors. 

Conclusion 

[0138] This concludes the description of the preferred embodiment of the invention. 
20 The following describes some alternative embodiments for accomplishing the present 
invention. For example, any type of computer, such as a mainframe, minicomputer, or 
personal computer, or computer configuration, such as a timesharing mainframe, local 
area network, or standalone personal computer, could be used with the present 
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invention. 

[0139] The foregoing description of the preferred embodiment of the invention has 
been presented for the purposes of illustration and description. It is not intended to be 
exhaustive or to limit the invention to the precise form disclosed. Many modifications 
5 and variations are possible in light of the above teaching. It is intended that the scope of 
the invention be limited not by this detailed description, but rather by the claims 
appended hereto. 
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WHAT IS CLAIMED IS: 

1. A method for supporting multiple interactive digital video streams 
comprising: 

receiving a first broadcast digital video stream; 
5 storing the first broadcast digital video stream into one or more I-files comprised 

of one or more intraframes (I-frames) and one or more PB-files comprised of one or 
more frames selected from a group comprising a predicted frame (P-frame) and a bi- 
directional predicted frame (B-frame); and 

providing a first display digital video stream based on the one or more I-files. 

10 

2. The method of claim 1 wherein the first display digital video stream is 
provided further based on the one or more PB-files. 

3. The method of claim 1 wherein I-frames within an I-file are skipped to 
15 support a fast scan. 

4. The method of claim 1 further comprising storing the first broadcast 
digital video stream into a receiving buffer for the first broadcast digital video stream. 

20 5. The method of claim 4 wherein the first broadcast digital video stream is 

stored in the one or more I-files and one or more PB-files when the receiving buffer is 
full. 
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6. The method of claim 1 wherein providing comprises storing the first 
display digital video stream in a display buffer. 



7. The method of claim 1 further comprising causing the first display digital 
5 video stream to be displayed to a viewer. 

8. The method of claim 1 further comprising providing a second display 
digital video stream based on the one or more I-files. 

10 9. The method of claim 8 wherein: 

the first display digital video stream is stored in a first display buffer; and 
the second display digital video stream is stored in a second display buffer that is 
different than the first display buffer. 

15 10. The method of claim 1 wherein the first display digital video stream 

complies with a motion picture experts group (MPEG) standard. 

11. The method of claim 1 further comprising allocating a set of memory 
pages for receiving the first broadcast digital video stream, wherein: 
20 the first broadcast digital video stream is stored from one of the memory pages 

into the one or more I-files and one or more PB-files when one of the memory pages is 
full; and 

the first display digital video stream is provided pursuant to reading data stored 
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in the one or more I-files when a decoder has consumed one of the memory pages. 



12. The method of claim 1 1 wherein the set of memory pages comprises 
four (4) memory pages. 

5 

13. The method of claim 1 wherein if free system memory is less than a 
minimum memory required to support a requested speedup fast-scan stream, the 
requested fast-scan stream is not provided as the first display digital video stream. 

10 14. The method of claim 1 wherein if free system memory is greater than a 

minimum memory required to support a requested speedup fast-scan stream, the 
requested fast-scan stream is provided as the first display digital video stream. 

1 5. The method of claim 1 wherein the one or more I-fiames are distributed 
15 into one or more I-files in a round-robin manner. 

16. The method of claim 15 wherein one or more I-frames numbered as Ii, 
I2, 13. ♦ .Im are placed among K I-files F h F 2} . . ,Fk , in the following round-robin 

manner: F { = j/, +nxje | n = 1,2,3 • • ~| . 

20 

17. The method of claim 15 further comprising: 

determining if free system memory is less than a minimum memory required to 
support a requested speedup fast-scan stream; 
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if free system memory is not less than the minimum memory required to support 
the requested speedup fast-scan stream, providing the requested speedup fast-scan 
stream as the first display digital video stream; and 

if free system memory is less than the minimum memory required to support a 
5 requested speedup fast-scan stream, reducing the requested scan speed until available 
system memory is able to support the reduced scan speed and providing the reduced 
scan speed stream as the first display digital video stream. 

1 8. The method of claim 1 wherein the one or more I-frames are organized 
10 into a tree-structure and each level of the tree structure is represented by one or more I- 

files. 

19. The method of claim 18 wherein each level of the tree-structure 
represents a fast-scan speed for the first display digital video stream that is provided. 

15 

20. The method of claim 18 further comprising: 

(a) if free system memory is not less than a minimum memory required to 
support a requested speedup fast-scan stream, providing the requested speedup fast-scan 
stream as the first display digital video stream; 
20 (b) if free system memory is less than a minimum memory required to 

support the requested speedup fast-scan stream and the requested speedup fast-scan is 
greater than or equal to a frame span factor 

(i) reducing the requested scan speed until available system memory 
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is able to support the reduced scan speed and the reduced speedup fast-scan is 
greater than or equal to the frame span factor; and 

(u) providing the reduced scan speed stream as the first display 
digital video stream. 

5 

21. The method of claim 20 wherein if reducing the scan speed does not 
result in the ability for available system memory to support the reduced scan speed or a 
reduced speedup fast-scan that is greater than or equal to the frame span factor, then the 
first display digital video stream is provided by: 

10 setting the scan-speed K to a x /? M x 8 , wherein a is a frame span factor, JS is 

a scan speed resolution factor, and S is an average number of frames in a frame 
sequence; 

reading I-frames from an I-file; and 

providing all I-frames read in the first display digital video stream, wherein a 
15 fraction of I-frames dropped are approximately equal to — . 

22, The method of claim 18 wherein an in-order traversal of the tree- 
structure is used to support normal playback for the first display digital video stream. 

20 23. The method of claim 1 8 wherein the I-frames are distributed among K I- 

files F/, F 2 ,- . .Fk , in the following manner 

F } ={l K \l£K<mnI K g{F 2 uF 3 uF 4 — uFj} such that 
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F ' = iW-' I" 6 to-l n/ «„^ *{F M uF l+2 vF M .:vF K }lfor2Z 
wherein a is a frame span factor, J3 is a scan speed resolution factor, and /Bis a 
number of frame sequences in the first broadcast digital video stream. 

24. The method of claim 1 8 wherein the I-frames are distributed among K I- 
files F h F 2 >. . .F/f , in the following manner: 

F x ={l K \\<K<*m} such that 

wherein a is a frame span factor, is a scan speed resolution factor, and mis a 
number of frame sequences in the first broadcast digital video stream. 

25. A system for supporting multiple interactive digital video streams 
comprising: 

(a) a receiver configured to: 

(i) receive a first broadcast digital video stream; 'and 

(ii) store the first broadcast digital video stream into one or moire I- 
files comprised of one or more intraframes (I-frames) and one or more PB-files 
comprised of one or more frames selected from a group comprising a predicted 
frame (P-frame) and a bi-directional predicted frame (B-frame); and 

(b) a scheduler configured to provide a first display digital video stream 
based on the one or more I-files. 

26. The system of claim 25 wherein the first display digital video stream is 
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27. The system of claim 25 wherein I-frames within an I-file are skipped to 
support a fast scan. 

28. The system of claim 25, wherein the receiver is further configured to 
store the first broadcast digital video stream into a receiving buffer for the first broadcast 
digital video stream. 

29. The system of claim 28 wherein the receiver stores the first broadcast 
digital video stream in the one or more I-files and one or more PB-files when the 
receiving buffer is full. 

30. The system of claim 25 wherein the scheduler is configured to provide 
the first display digital video stream by storing the first display digital video stream in a 
display buffer. 

31. The system of claim 25 further comprising a display thread that displays 
the first display digital video stream to a viewer. 

32. The system of claim 25 wherein the scheduler is further configured to 
provide a second display digital video stream based on the one or more I-files. 
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33. The system of claim 32 wherein the scheduler: 

stores the first display digital video stream in a first display buffer, and 
stores the second display digital video stream in a second display buffer that is 
different than the first display buffer. 

5 

34. The system of claim 25 wherein the first display digital video stream 
complies with a motion picture experts group (MPEG) standard. 

35. The system of claim 25 further comprising a resource manager 

10 configured to allocate a set of memory pages for receiving the first broadcast digital 

video stream, wherein: 

the receiver is configured to store the first broadcast digital video stream from 

one of the memory pages into the one or more I-files and one or more PB-files when 

one of the memory pages is full; and 
15 the scheduler is configured to provide the first display digital video stream 

pursuant to reading data stored in the one or more I-files when a decoder has consumed 

one of the memory pages. 

36. The system of claim 35 wherein the set of memory pages comprises four 
20 (4) memory pages. 

37. The system of claim 25 wherein if free system memory is less than a 
minimum memory required to support a requested speedup fast-scan stream, the 
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scheduler does not provide the requested fast-scan stream as the first display digital 
video stream. 



38. The system of claim 25 wherein if £tee system memory is greater than a 
minimum memory required to support a requested speedup fast-scan stream, the 
scheduler provides the requested fast-scan stream as the first display digital video stream. 

39. The system of claim 25 wherein the receiver stores the one or more I- 
frames into one or more I-files in a round-robin manner. 

40. The system of claim 39 wherein one or more I-frames numbered as Ii, I2, 
I3. . .Im are stored among k I-files F h F 2 ,. . ,Fk , in the following round-robin 

manner: F t = \ I i+nxK | n = 1,23- ■— ► . 

41. The system of claim 39 wherein the scheduler is further configured to: 
determine if free system memory is less than a minimum memory required to 

support a requested speedup fast-scan stream; 

if free system memory is not less than the minimum memory required to support 
the requested speedup fast-scan stream, provide the requested speedup fast-scan stream 
as the first display digital video stream; and 

if free system memory is less than the minimum memory required to support a 
requested speedup fast-scan stream, reduce the requested scan speed until available 
system memory is able to support the reduced scan speed and provide the reduced scan 
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42. The system of claim 25 wherein the receiver is further configured to 
organize the one or more I-frames into a tree-structure and each level of the tree 

5 structure is represented by one or more I-files. 

43. The system of claim 42 wherein each level of the tree-structure 
represents a fast-scan speed for the first display digital video stream that is provided. 

10 44. The system of claim 42, wherein the scheduler is further configured to: 

(a) provide the requested speedup fast-scan stream as the first display digital 
video stream if free system memory is not less than a minimum memory required to 
support a requested speedup fast-scan stream; 

(b) if free system memory is less than a minimum memory required to 

15 support the requested speedup fast-scan stream and the requested speedup fast-scan is 
greater than or equal to a frame span factor: 

® reduce the requested scan speed until available system memory is 
able to support the reduced scan speed and the reduced speedup fast-scan is 
greater than or equal to the frame span factor; and 
20 (ii) provide the reduced scan speed stream as the first display digital 

video stream. 

45. The system of claim 44 wherein if reducing the scan speed does not 
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result in the ability for available system memory to support the reduced scan speed or a 
reduced speedup fast-scan that is greater than or equal to the frame span factor, then the 
scheduler provides the first display digital video stream by: 

setting the scan-speed K to a x /? M x S , wherein a is a frame span factor, fi is 
5 a scan speed resolution factor, and 5 is an average number of frames in a frame 
sequence; 

reading I-frames from an I-file; and 

providing all I-frames read in the first display digital video stream, wherein a 

fraction of I-frames dropped are approximately equal to — . 

ft 

10 

46. The system of claim 42 wherein the scheduler performs an in-order 
traversal of the tree-structure to support normal playback for the first display digital 
video stream. 

15 47. The system of claim 42 wherein the receiver stores the I-frames among 

K I-files F h . . .Fk , in the following manner: 

F l = {l K \l< l ic<>mnI K <£{F 2 KjFsKjF A ---vF K }} such that 
F i = fcx«*,M | n e {1,2,3, • . •} n / ^ e {F M u^ 2 u^^u F k }} for 2 < / < , 
wherein a is a frame span factor, 0 is a scan speed resolution factor, and m is a 
20 number of frame sequences in the first broadcast digital video stream. 

48. The system of claim 42 wherein the receiver stores the I-frames among 
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K I-files F,, F 2) . . .Ftc , in the following manner 
F i ={l K \l<K^m} such that 
^ = L«x^l" e to-Hfor2<f</c 

wherein a is a frame span factor, J3 is a scan speed resolution factor, and wis a 
5 number of frame sequences in the first broadcast digital video stream. 

49. An article of manufacture comprising a program storage medium 
readable by a computer hardware device and embodying one or more instructions 
executable by the computer hardware device to perform a method for supporting 

10 multiple interactive digital video streams, the method comprising: 
receiving a first broadcast digital video stream; 

storing the first broadcast digital video stream into one or more I-files comprised 
of one or more intraframes (I-frames) and one or more PB-files comprised of one or 
more frames selected from a group comprising a predicted frame (P-frame) and a bi- 
15 directional predicted frame (B-frame); and 

providing a first display digital video stream based on the one or more I-files. 

50. The article of manufacture of claim 49 wherein the first display digital 
video stream is provided further based on the one or more PB-files. 

20 

51 . The article of manufacture of claim 49 wherein I-frames within an I-file 
are skipped to support a fast scan. 
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52. The article of manufacture of claim 49, the method further comprising 
storing the first broadcast digital video stream into a receiving buffer for the first 
broadcast digital video stream. 

5 53. The article of manufacture of claim 52 wherein the first broadcast digital 

video stream is stored in the one or more I-files and one or more PB-files when the 
receiving buffer is full. 

54. The article of manufacture of claim 49 wherein providing comprises 
10 storing the first display digital video stream in a display buffer. 

55. The article of manufacture of claim 49, the method further comprising 
causing the first display digital video stream to be displayed to a viewer. 

1 5 56. The article of manufacture of claim 49, the method further comprising 

providing a second display digital video stream based on the one or more I-files. 

57. The article of manufacture of claim 56 wherein: 

the first display digital video stream is stored in a first display buffer; and 
20 the second display digital video stream is stored in a second display buffer that is 

different than the first display buffer. 

58. The article of manufacture of claim 49 wherein the first display digital 



55 



WO 02/28097 PCT/US01/30116 
video stream complies with a motion picture experts group (MPEG) standard: 



59. The article of manufacture of claim 49, the method further comprising 
allocating a set of memory pages for receiving the first broadcast digital video stream, 
wherein: 

the first broadcast digital video stream is stored from one of the memory pages 
into the one or more I-files and one or more PB-files when one of the memory pages is 
full; and 

the first display digital video stream is provided pursuant to reading data stored 
in the one or more I-files when a decoder has consumed one of the memory pages. 

60. The article of manufacture of claim 59 wherein the set of memory pages 
comprises four (4) memory pages. 

61 . The article of manufacture of claim 49 wherein if free system memory is 
less than a minimum memory required to support a requested speedup fast-scan stream, 
the requested fast-scan stream is not provided as the first display digital video stream. 

62. The article of manufacture of claim 49 wherein if free system memory is 
greater than a minimum memory required to support a requested speedup fast-scan 
stream, the requested fast-scan stream is provided as the first display digital video stream. 

63. The article of manufacture of claim 49 wherein the one or more I-frames 
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are distributed into one or more I-files in a round-robin manner. 

64. The article of manufacture of claim 63 wherein one or more I-rxames 
numbered as Ii, te f h. . .Im are placed among k I-files F h F 2> . . .Ftc , in the following 

round-robin manner: F t - \ I i+nxK \ n = 1,2,3 

I fc 

65. The article of manufacture of claim 63, the method further comprising: 
determining if &ee system memory is less than a minimum memory required to 

support a requested speedup fast-scan stream; 

if free system memory is not less than the minimum memory required to support 
the requested speedup fast-scan stream, providing the requested speedup fast-scan 
stream as the first display digital video stream; and 

if free system memory is less than the minimum memory required to support a 
requested speedup fast-scan stream, reducing the requested scan speed until available 
system memory is able to support the reduced scan speed and providing the reduced 
scan speed stream as the first .display digital video stream. 

66. The article of manufacture of claim 49 wherein the one or more I-firames 
are organized into a tree-structure and each level of the tree structure is represented by 
one or more I-files. 

67. The article of manufacture of claim 66 wherein each level of the tree- 
structure represents a fast-scan speed for the first display digital video stream that is 

57 




WO 02/28097 



PCTYUS01/30116 



provided. 

68. The article of manufacture of rkim 66, the method further comprising: 

(a) if free system memory is not less than a tnininrmm memory required to 
support a requested speedup fast-scan stream, providing the requested speedup fast-scan 
stream as the first display digital video stream; 

(b) if free system memory is less than a minimum memory required to 
support the requested speedup fast-scan stream and the requested speedup fast-scan is 
greater than or equal to a frame span factor: 

(i) reducing the requested scan speed until available system memory 
is able to support the reduced scan speed and the reduced speedup fast-scan is 
greater than or equal to the frame span factor; and 

(n) providing die reduced scan speed stream as the first display 
digital video stream. 

69. The article of manufacture of claim 68 wherein if reducing the scan 
speed does not result in the ability for available system memory to support the reduced 
scan speed or a reduced speedup fast-scan that is greater than or equal to the frame span 
factor, then the first display digital video stream is provided by: 

setting the scan-speed K to a x /? M x 5 , wherein a is a frame span factor, is 
a scan speed resolution factor, and S is an average number of frames in a frame 
sequence; 

reading I-frames from an I-file; and 
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providing all I-frames read in the first display digital video stream, wherein a 
fraction of I-frames dropped are approximately equal to ~ . 



70. The article of manufacture of claim 66 wherein an in-order traversal of 
5 the tree-structure is used to support normal playback for the first display digital video 

stream. 

71 . The article of manufacture of claim 66 wherein the I-ficames are 
distributed among K I-files F h P^* • - J 7 *" , in the following manner 

10 F x ={l K \\<K<mnI K &{F 2 KJF l vFt~-\jF K }} such that 

3 = ft™*" l" 6 ^ 2 ^^ *{F M vF M KjF M ~-vF$fbr2 
wherein a is a frame span factor, fi is a scan speed resolution factor, and m is a 
number of frame sequences in the first broadcast digital video stream. 

15 72. The article of manufacture of claim 66 wherein the I-frames are 

distributed among K I-files F h F 2 ,.. .Fk , in the following manner: 
F x = {l K 1 1 < k < m} such that 

wherein a is a frame span factor, J3 is a scan speed resolution factor, and mis a 
20 number of frame sequences in the first broadcast digital video stream 
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